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ABSTRACT 

An "intelligent" system for constructing 
computer-assisted pattern drills to be used in second language 
instruction is proposed. First, some of the difficulties in designing 
intelligent error analysis are discussed briefly. Two major 
approaches to error analysis in computer-assisted instruction, 
pattern matching and parsing, are described, and their advantages and 
disadvantages are examined. A third approach that appears to minimize 
technical problems is then outlined. This approach is based on the 
idea that a limited list of randomly generated sentences in the 
target language is useful in constructing transformation or pattern 
drills. The system consists of four parts including: (1) a module in 
which sentence templates can be constructed; (2) a procedure for 
transforming linguistic material into target language sentences? (3) 
stimulus sentence creation, including student response; and (4) error 
analysis, providing feedback to both the student and the 
sentence-generating system and allowing tailoring of further stimulus 
sentences. Some problems of implementation are discussed, including 
system response spead, feasibility of expansion beyond simple 
sentences, generation of inappropriate sentences, and constraints 
imposed by left-to-right template construction, transformation, and 
response judging. (MSE) 
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TEMPLATE CONSTRUCTION AS A BASIS FOR ERROR-ANALYSIS PACKAGES 

IN LANGUAGE LEARNING PROGRAMS 



Stephen C. Hcimrdch 



In this paper, I describe a set of programs which work interactively 
with the teacher/instructor to create a template from which an indefinite 
nkimber of stimulus sentences can be generated. The instructor also qiecifies 
exactly how the stimulus sentence is to be transformed into the target 
sentence. Using this set of transfmnation .{tcps, the student's response is 
judged am! feedback is suppUed to the student Feedback is also given to the 
stimulus-generating system, allowing it to tailor the construction of further 
stimulus sentences to the difficulties encountered by the student in previous 
attempts. 



INTRODUCTION 

Computerization of language learning lessons is still in its early stages. In particular 
the analysis of student responses to drill items is generally simplistic and the feedback often 
counter-productive. In this paper I describe a computer program that I believe represents a 
substmtial advance over systems currendy available. It permits pedagogicaUy oriented, drill 
specific feedback and alters the presentation of stimulus material in response to errors 
encountered m analysis of previous smdent responses. 

Error analysis is the main focus of the approach I am proposing here. It is in this area 
tnat the program offers the naost substantial improvement over other approaches. Ho^/evcr 
the program itself cncnnpasses more than just an error analysis package. It offers, in fact, a 
complete computerization of a certain type of language driU, namely, transformation 
exercises, or pattern dnUs. Once it has been provided by the instructor with a pattern for the 
dnu and a procedure for denving the correct response from the stimulus, the program will 
construct appropnate stimulus sentences, correctly deteraiine the target sentences, analyze 
the student s response, and provide feedback to both student and teacher. It may also handle 
a snudl group of highly constrained tanslation exercises. However, by itself, it cannot 
provide a complete set of computerized language-leaming lessons. 

A ftz , ^ section I provide background information, pointing out some of the 

difficulties of .ntelhgent error analysis, describing alternative approaches, and placine 
template constnicnon widiin the larger friunewoik of language generating systems 
J>ubsequent sccoons provide a detailed description of the system and a conclusion, which 
summanzcs both the advantages and some disadvantages of this approach. 

BACKGROUND 
Probleira of Intelligent Error Analysis 

We as teachers are continually involved in error detection, error correction, and error 
are performed routir^^ly and are weU within tht capabiUties of most 
tcacners. One might think, therefore, that computerization of this process would be fairly 
simple. However, what we are doing is something extremely complex and subUe. In 

^SuSf r^ITI^* Sf T!;? *^"*H" cogm'tive processes which 

?I^nS.. f Identification of these processes is vital to the task of providing 

appropriate feedback to the smdent to aid in correction of the error. Moreover, these 
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processes arc not even open to conscious inirospectioo, since it is usually the student s 
conscious intention to produce the correct answer. However, the main difficulty in 
iPtelligent ciror analysis is that the interpretation of the objective enor is ambiguous. 

First of all, it is ambiguous linguistically. The same physical error may represent a 
cognitive error at several linguistic levels. It may be an error at a fairly low level (typing, 
spelling), at an intermediate level (inflection, agreement, word order), or at a high level 
(word choice, idiomaticity, appropriateness). For instance, findmg the word chevaux 
instead of "cheveux" in a French sentence may be a spelling error, a morphology error, or 
possibly a word choice error. r- • . 

Second, there are many possible causes for any particular error For mstance, one 
and the same error may represent a simple oversight, a temporary lapse, a gap in the 
student's knowledge, interference from the student's native tongue, a misunderstaiiding oi 
the instructions, or a major misconception about the target language. Our choice oiten 
depends on many other things we know about the student: general level of knowledge, past 

'**^^°™Another*factor which makes the computerization of error analysis difficult is that it is 
task dependent. That is, an error in one situation may not be an error in another, tor 
instance, vocabulary tests are generally geared to a particular set of items. Using «notner 
word with the same meaning might get the student marks for ingenuity, but would still be a 
wrong answer. Even if errors "count" in different situations, the>; may have different 
weights. For instance, a spelling error would count heavily on a speUing test, and probaDly 
for little in an extended essay. . * . . 

Thus, what makes intelligent error analysis difficult to computerize is the fact that 
physical errors in the text are ambiguous. Their interpretation and evaluation depends on an 
analysis of : le Unguistic import of the error and of its probable cause. Even if this can be 
done, the weib''t given to errors v,ari«s from exercise to exercise. 

Other Approaches to Computerized Error Analysis 

There have been two major approaches to error analysis in computer-assisted 
learning programs. The Hrst is simple pattern matching. With this approach, the student s 
input is treated as a flat (unstrucmred) string of characters. The input is searched for certain 
words or phrases. This method requires a pattern (a correct answer) against which the 
student's input can be matched. As such it is a fairly unintelligent approach to error analysis. 
However, in ius favor, it can serve as a general purpose approach, workable for almost any 

input in any language. , . » r 

Parsing the input is & more intelligent approach to error analysis. Because of work 
done both in computer science and linguistics on the nature of grainmars and parsers for 
natural language, some of the princ oles of parsing and some of the basic strucmrts ot 
natural languages are fairly well ur\derstood. The parsing approach, therefore, tnes to 
analyze the student's input in structural terms, not simply as a flat stiing of characters. The 
structures it looks for are those of the foreign langiuge, so it must "know something about 
these structures. In this sense, it is tmre inteUigent. In addition, it is not bound to sittiations 
where a clear-cut pattern is available against which to judge the student s uiput. With an 
adequate grammar of the target language, a parser can handle almost any uiput m the 
language. In this respect, it appears to mimic human analysis of language. Since we do not 
always know what it is we will be hearing or reading, we must analyze the input we receive 
and assign it a structure and meaning. j- , • 

It would be tempting to think that this work could be taken over direcUy mto error- 
analysis programs. However, almost all such work deals only with analyzing correct input 
Bad or incorrect input is generally discarded or ignored. Incorrect uiput, unfortunately, is 
exactiy what must be examined and analyzed in error analysis. In addition, a parser that can 
analyze most natural language input and operate at a reasonable speed will be quite complex 
and unintuitive. This is because the tasks of computationally optimizing a paper and of 
providing a linguistically sophisticated grammar are both highly complex aiuJ techmcal. 
This means that it is difficult to make si :h programs interactive and task dependent, " also 
is not an easy job to take the complex ai alysis provided by the parser and turn it into helpful 
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nt.r^M/at^;^.^^^^^ ;VS!f4- orB^. PH^pIe B" . 

devcloprrSt'^f :SSp?«r'J^X'L^^ «>t be p«™^ in the 

necessary if these prog»^ms «c to dS^A h^LS^E^i In fact, it is clearly 
ouUined above, there are sevSal ImrDJSvmT.JTf"* ^ ^ However, as 

applying what we know aS^t lanSae'^S^^ J";2Lf* *^J^«* " P««» of 
routines in particular, to SSpuS uS-lSrC^S? computen«d paning 
suggesnng another approach that docs^ seS^ro nS?i ^. programs. Theitfoie. I am 
Although it is appUckble to a moS^^SlSJ SSf 3^** ""-^ ^^""^ problems. 
quite useful as « intennediateXe Ke <te?^^^ 'P^""*^"' « "«y P«»vc 

This approach involves the use T^pl^lstgS^^^s^^"^' 



Generating Systems and Templates 



generatrr^siJipli^r^^^^ system, or language 

that associates each ''phonetirf«i«''?^«lIf i ' grammar is a formal system 

(meaning). It is simuLTa^SaLS fCSS^ a!^^ -"P^P ^* * W 
<«ntence. meaning>. A panor is™ a SSTi? \ " " ,* ^ 
which can be appU^ to an Smut f ni«lJ of a piocfdure 

structured mcaA&ig KiSe^^ie,SS,T«Si!^ « 
powdure. That ij it tak^ S inp^; " '"^^^ or 

langi age that encodes thjTinSg P^**' " *>"*P"' • «"tence of a mitural 



gcnerati,;g"sySs!°F^t:fiirSS?is^^ f^^ «~ of than 

like. By contrast, a "sentence" i^ Xly owSSt^/^S?^*' * « or looks 

Stan wit^ a sentence and work towardw^M iS?of «.<*«^y n»rc feasible io 

versa. Second, in most c^^At^i^^fi^^S^'^^^ tcprescntotion than vice 
program that can ''understS^CiLSn2SSif?f„?^r*? '''"^ researchers are aiming is a 
that they need to^^cate.^ tfTS^T .^^^^ ^avr. ver/litUe 

stmplined statements that do n«^^^ res- onscs and 

be much more useful than a genenSSgsySn? P^^S- Therefore, a parser would 



than Papr?.?SSuteis1o"c^^^^^^^ difficult problems 

like. The problems of adapting swh a sS?S?iS?»S ^ «*«fting) should look 

even more formidable Am fo?a wli^I^tS ?^ of bKonect stwllnt inpuf seem 
nval that of p-T«rs. ™ complexity of the program .^d ceriairjy 

Given ."^ssis^sssMiTsr^^ 

program randomly generates gSS^tST^te^s ^J?^ri!^f transformations), this 
pmmar. This type of generatSTaTSteSX^ *at 
It IS fairly simple to implement teclSSSv £, iu^. scmmtic considerations, 

unclear. How could a ik of gnStiSl ^inten^s ^SSSlISf! systems is 

student enon? ^ "^lucai sentences, randomly generated, help in analy.ting 

betwee^^U^S^lUta^^ JvS'l.'^^Iiili*"' — - 

constrained list of randomly iSSMed SS?2J£ 2^!!^^.'* »,««>unded in the fact that a 
particular type of lill^J^SS^^ » the construction^ J 

In tWs type of exeici«« tiu . • """^'y "e transformation drill, 
perform »me ^cd^'^^'tSlS^Ta^^^'^ * ^ ^ told to 

include pluralirCg noun phras«^^ dSmSia £ SL^*^' ^^P"^ transformational drills 
imperatives or (juJstioos. orreSciar^^ statements into 

<jses theroeai3ngoftlSsento^rs^^^2^ Inmost 

syntactic transformations. The stimurs^teSSHi In^^,?'". » ^o, inculcate certain 

5cnici>ces are generally smdlar m syntactic form. 



ERIC ^ 



100 



and the student response is usually obuin«l by a straightfc^ard syntactic tn^^ipul.tion of 

syntactic template (using °Vnf stimuK ^^^er then spwifics 

jidagogical grammars) for ^« 8":";^ J^^^^ .^"."^ 
^xacUy how thii sumulus sentence '^j^^* J^^JJ^ of stimulus sentences and also 
this information, the program can generate any J^'^^^w an undcrsumding of the steps 
automatically produce the correct «sPO"«- Vl";"' '^^^^ student's response to see if 

to be followed to create the correct answer it can easily ^^'JJ^ tough, non-technical 
those steps were followed. A P'«6\'^»!^ ^ ^/^^J^^ 

application of early transformanonal fff^^^^Y'^l^.^cr for *e teacher, that is if 
If this were all the pro^ did. u trught ^a t^i„g i„ the stimulus 

constructing the template and the ^^"^ ^ii^foS^^ ^^^''^ 

sentences themselves. However using this approach inroraan e detection of 

sentences of the type which posed some problems for the student. 

DESCRIPTION OF THE SYSTEM 

in this section. 1 wiU explain J^^^.te^J,^^^^^^ 
proposed program. A prototype J^^^ J^^^ to ^ »° 

miniftial implementation of each *f,™^ also describe the functioning of 



(1) Jc vais au cin6ma. 

Lc chal mange Ic poisson. 

(2) Nous allons au cinema. 
Lcs chats mangcni lc poisson. 



AS can be «.n i„ 1, .he sy«en, »n»«s of fo^ ^u^'S^S? 1^^" 

consmiction nwdule, the language-specific 
and the eiTor analysis jcogran. In »*b°on *e« ™JSes md mnsfoniiions. There 

[rr riS «£r -T.tS'Su'fsST'ss p.- ^ 

called upon by the four main piograms. 
Template Construction 

Template construction can be visualized as «SeTan°Ue%'^'^^^^ 
reflects tSe various syntactic shapes that a snmulus «n^^ ^^^f^ is ^STstructed in a 
possible template for the construction of ^example s^^^^ ^ „^ 

fop-down, nearly depth-first r^^^^J^^^ svnSc cawgory of the leaves (terminal 

™i.s?i!^*^^'^t?.*^a"^'^™s?b&sfc™.^^^ 

produce the target output. , . possible types: they may lead to 

' The branches under each node must be one of Juee ^ v stimulus, or they may 
options in stimulus construction, they may lead to requurd parts oi uie 
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Figure 1 . Model of a temi^te construction system for enor analysis 
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lead to the selection of a lexical item to fill a spoi in the stimulus sentence. The instructor 
must specify which type of branching occurs iM^neath each node. For instance, in our 
example, ben^th the node SENT, the instructor specifies two other nodes, SU6J and 
VERBP. These will subsume the subject and the veib phrase of each sentence. Since both a 
subject and a verb phrase are required for each sentence, each branch must be taken when 
ccnstiucdng a stimulus sentence. 

However under the node labelled SUBJ. we find nodes labelled PRO and DETN. 
These nodes represent the construction of a subject consisting of either a pronoun or a 
determiner noun sequence. Since either is a complete subject and both together would be 
ungrammatical« the branches to these nodes are options for the stimulus constructing 
program-i: must take one and only one of these paths. 

Finally, a branch may lead to a terminal node (leaf) of the tree. In this case, a lexical 
item must be selected to fill the terminal node. The instructor is asked to specify the lexical 
category and the features that the lexical item must bear. In this case, the features ''singular" 
and "animate ' have been selected. In the PRO branch the lexical category "pronoun** has 
been selected and in the DETN branch the lexical category **conunon_noun." When a lexical 
item is to be selected, the instructor must idso specify whether the lexical item selected must 
agree with any other item in the template. In our example, the determiner must agree with 
the subject noun and the subject noun with die verb. Both the feature system and 
morphology will be discussed in detail below. 

In addition to the completely teacher-specified templates, there are additional built-in 
functions which can generate random constituents such as noun phrases, prepositional 
phrases, verb phrases, adverbial phrases, etc. If the content of these constituents is not 
relevant to the exercise at hand, the teacher need not specify completely their construction. 
For instance, in our example, the form and content of the object noun phrase is not relevant 
to the task of pluralizing the sentence. 

Features 



Features play an in^)ortant part in this template system, since it is by means of 
features that much of the flexibility of the system is obtained. Most lexicons are organized 
as shown in (3), with each lexical item attached to a list of its own features. In this system, 
however, the feature names are entered with a list of the lexical items bearing that feature 
attached, as shown in (4). 
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(3) chat (noun masc animate common) 
plume (noun fem common) 
manger (verb active) 

(4) noun (chat plume) 
conuDon (chat plunge) 
verb (manger) 

This organization means that the selection procedure involves taking the sets 
associated with the features selected, intersecting them, and randomly choosing one lexical 
item from the intersection. This item will bear all the features selected by the teacher. 

It is important to note that neither the lexicon nor the set of features is static. Words 
can be easily added and features can be easily assigned. This means that the selection 
process for lexical items can be closely controlled by the teacher. For instance, a feature 
could be created such as **noun finom die vocabulary list for lesson nine.** Using this feature, 
the teacher could limit selection to certain vocabulary items. The features could also be 
semantic in nature. A possible feature might be **anicles of clothing** or **things to eat.** 
Thus by the use of this flexible feature system, semantic constraints can be ensured. 

It is also important to note that these features, whether syntactic or semantic, are 
intended tc be inherent features of the lexical item itself. Morphological variation (primarily 
the agreement features) would be taken care of by independent pre- p rogrammed modules. 
Therefore, to enter a regular lexical item it would not be necessary to enter more than the 

O 
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ciudon form. Morphological variation wouid be handled automatically. (Iiregular variation 
would need to be entotd into the appropriate compuution module.) these functions* when 
provided with a lexical item and a set of nmphological features, return the correct 
morphological form as tiieir result. If a feature is left unspecified (sav, for exaniple, tense)* it 
would be suppH^ at random. In addition, this functional approach to morphology allows 
closely related and even incorrect fcmns (a regular stem in place of an irregular correct stem, 
or a future stem with a present ending) to be generated and stored with the correctly 
generated form. These are used later to perform a primitive sort of morphological error 
checking. 

Transformation Procedure 

Once the template is constructed* the teacher must then specify exactly what actions 
are to be performed in order to create the correct target sentence. The transformation 
program operates from left to right, so changes must be specified in sequence through the 
sentence. For instance, in our example, the instructor must specify first changes to be made 
tr the subject noun phrase and then to the verb phrase. 

Any node of the stimulus template may be specified as subject to transformation. 
The instructor has four options to choose from in specifying the appropriate transformation 
of the stimulus sentence: copy, insert, delete, or alter. Copy results in a verbatim copy of 
whatever lexical items lie under the node selected Insert involves the insertion of specified 
material. New material may be specified, or another node from a different part of the 
stimulus. Insertion must occur between constituents of the stimulus sentence. Delete is 
simply the removal of the specifi^i material. Thus, insert and delete together provide a 
nx)vement transformation. Alter involves changing tiie feature matrix of a specified lexical 
item, such as tense, number, and other syntacti^morphological features. In addition, thtit' 
are available several pre-progranuned functions which can provide certain commonly* 
performed feature alterations. These would be available to apply to larger scale constituents 
than lexical items. Such functions as changing tense, number, or case wouid be available, 
allowing the teacher to avoid directly nuuiipulating the feature values themselves. 

After specifying the constinient and the action to be performed on it, the teacher may 
provide an error message to be used if the snident fails to execute properly this part of the 
transformation. Default messages for each kind of transformation are also available. 

As can be seen from the above specifications of the stimulus template and the 
transformation construction, (tittt is more than one way in which the same drill could be 
formulated. The instructor can choose how detailed a template to construct. The more 
detailed a template, the more detailed can be the specification of the transformation. The 
more steps in the transformation, the greater the number of "errors'* the student may commit- 
-each ''error** being related to one step of the transformation. Thus the teacher controls how 
detailed the analysis of the student's work is. 

Stimulus Creation 

Given the template structures for a drill as specified by the teacher in the foregoing 
sections, the actual creation, presentation, and judging of a transformation exercise is fairly 
routine. 

First, using tiie template, a stimulus sentence is consuucted. That is, starting at the 
root node, the program traverses the stimulus template tree. If the node it is examining is has 
optional branches, only one branch (randomly chosen) will be traversed and the others 
ignored If the branches are specified as part of a construction, each branch will be traversed 
in turn. If the node is a terminal node, an appropriate lexical item is selected. Agreement 
routines are executed. The tree- structure for the stimulus is stored and the lexical terns are 
strung together and presented on the screen to the snident. 

Once the student has typed in a response, the judging sequence begins. Following the 
transformation schema specified by the teacher, the program checks each step to see that it 
h^ been successfully completed by the student. Thus, a copy step merely involves checking 
to see if the identical material in the stimulus sentence is in the snident 's response, and at the 
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appropriate place. Insertion and alteration steps check f t the "S^" J^^r 

SKtion.^ In addition, if an error is found in an altcraaon step. 
forins generated earlier arc checked to see if the sttKtent's response IS among thern. 
tormsgeneniea ^^^^ ^ ^ checked since there is no way to sec tf 

something is not there, so evaluation is deferred. If J«J»»E:j^ Slo ^ f 
presumed that the prior deletion was properlv executed. If not, the program checks to see ii 
the deleted material is still present in the snident's response. . 

In each situation, if evaluation fails, the appropruite error message is printed, inus, 
the student is led through the necessary transformations step by step. 

Error Analysis 

In addition to providing appropriate response to snident errors, the program allows 
for a feedback loop from error analysis to stimulus generation. 5?"^*^^^ 
spontaneously generated. TOs means that the stunulus sentences »h« ••'J^ent » f^f^^^ 
with can be weighted to favor those types of sentences that proved difficult m earlier 

attempts.^^ instance, data about which branch of the option node of a template was chosen is 
stored. Information about the number of errors a snident made for each c^stitutent ofcach 
scnSce is also correlated with the branches present in that sentence. This »Uows for the 
we"^liting of option nodes, so that options w^dch resulted in sentences causing difficulty 

rSSifto'SSphisizc the importance of this feedback loop, since it represents one of 
the significant advantaaes of this approach over a P"*"^ T^t^"^^^ 
oarsinE and enor-analysis routine, a teacher would need only to type in the stimulus 
SSer«nflS correct response. Ute parser could easily Pjrse ""J 
use that as a target against which the smdem response would *»J«»8«*- .^^^y^^'.^^^J 
program could not generate new stimulus sentences, and thus could not individuahze the dnU 
appropriately for each student 



CONCLUSION 

The "IntelUgeiKe" of the System 

At this point, it is appropriate to summarize and highlight those aspects of the 
proposed approach which permit it to be somewhat "intelligent" ui the creation of 
transformation drills and analysis of student responses. 

In the first place, the teacher interacts with Ae program to create thednll. The 
teacher's intelligence is. therefore, integrated into the constructiop of the drill. This is tnaae 
possible by several features of the program. First, the flexibUity of *e template consttucjon 
process allows the teacher to specify in greater or lesser detail the structure of the dnll 
template. Second, the ease with whkjh features may be added to the system pcnmts *e 
teacW to tighUy constrain the random choice of lexical items for the dnU. Third, the 
aUowance in the program for extended, specific error messages written by the teacher 
incorporates the teacher's knowledge of probable student errors. . . „ 

In the second place, there is the built-in knowledge of the language that aUows for 
"intelligent" driU construction. Hiis knowledge includes the buUt-in lexicon and feature 
system; the construction functions which contam information about the grammar of certain 
constinients of the language, and the morphological functions which contain stored 
information about the regularities and irregularities of morphological systems m the 
language. This built-in knowledge interacts with the teacher's input to allow the instructor to 
concentrate on specifying the significant constructions for the purpose of the exercise and 
allows peripheral areas to be handled automatically, with minimal attention 

FinaUy. there is the feedback loop from error analysis programs to the construction of 
stimulus sentences for the drill. This aUows "intelligent" construction of stimulus sentences. 

lu 
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That is, sentenMs are presented that help the student leam by concentrating on areas where 
the greatest difficulty Ues. 

Problems of Implementation 

A few problems that may arise in the complete implerocnution of this system should 
DC mentioned. These are mainly problems of scale. That is, there are questions of how well 
the system would woric with a large lexicon, a large set of features, and a significant set of 
built-in funcbons. 

The fu^t concern is whether or not the response speed of the system can be 
maintained with such a larger data base. 1 suspect that a reasonable speed can be maintained 
particularly if compiled code is used. 

The second concern is whether or not the set of features and constructions necessary 
to handle a wide variety of constructions in the target language would make the system too 
unwieldy for the average teacher to work with. As with most systems, unforeseen problems 
wui anse as it expands, demanding exceptional or ad hoc lolutions. This may make the 
^tem too large to be handled by a typical foreign-language teacher without a great deal of 
hngmstic or compuurional background uwu i 

Thethiid concern is about the nature of Ac stimulus sentences generated by the 
program. There is cunenUy a great deal of interest in communicative competence and the 
sunulaoon of wppropnate conversational situations. This program, with its hmited semantic 
? P?*»Wy generate grammatically correct, but semantically odd sentences. 

How odd. It woukl be diftcult to teU. To some extent, these odd sentences might be 
amusing to Uie student/leamers. However, care omst be taken that the oddness docs not 
"iSfl. . ■ }} ^ accepttble for the program to generate sentences like 

f>auy ate the stone . However, it shouM not generate a s.ntencc like "Sally ate tfie 
sincerity. Avoidmg sentences like the latter might overburden either Uie system or tfie 

Finally, th«e is a concern about tiie current left-to-right prcxsedure in templatc- 
construction, transformation, and response judging. A brief kwk at typical pattern driUs 
shows that it would not pose unnatural constraints on the instructor to specify 
transformational changes in a strict left-to-right order. However, in some cases, it miaht be 
uiuntuidvely or pedagogically better to wotk tfirough the transfonnation in some way other 
than Mtt to right 

The advantage of this strictiy sequential mctiiod is that it avoids one of the major 
proDicms of a pattern matchuig approach. That is, in matching up the student input witfi the 
correct response panem, it is very difficult for pattern matching to deal with misplaced 
constituents or scrambled wond oider. Of course, it also can match sequentially left to riaht, 
stoppwg if It fails to match exactiy. But because there is no structureto the pattern, there is 
no way it can faww more about the eiror than that it is not an exact match with the correct 
response With the template approach, the program "knows" what each constinient in the 

«S^S^*^ifnSl!; »K ' P^^^'^ Poin*' ^ appropriate error message is 

generated, helpmg the student correct the error at that point 

Summary 

. ^. P^I^ ' propose an "intelUgent" system of computerized drill construction. It 

operates uiteracovely with tfie instructor to create a template for stimulus sentences and a 
SMuence of transformations which change the stimulus sentence into tfie target sentence. 
Usmg a biult-in system of features, morphological fimctions and constructions, tfie program 
prescnte stimiUus sentences generated according to tfie template and Judges tfie student 
^S22?J^ ^ die steps in tfie transformation process. A feedback loop permits tfie 
generation process to be sensitive to enon committed by tfie student 
• _ S P?,^,^^® features of such a system include tfie following: (1) it allows tfie 
SS?nf^h^^'^^^ « constructing tranrformation drills tfiat are spccifi? to tfie instructional 
f^n^ ^ T"^^ ^ difficulties of tfie student; (i)it encourages clarity on 

tfic part of tfie teacher ,n specifying clearly, what the possible shapes of tfre sritSulus 

> i 1 

IC 



106 



sentences tie tnd what must be done to produce the correct responses; (3) it enables flexible 
(goal-related) error analysis; (4) it permits the construction of an indefinite number of drill 
sentences, diifferentially for each student in relation to prior errors. 
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